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Conditional measure and the violation of Van 
Lambalgen’s theorem for Martin-Lof randomness 

Bruno Bauwens * * 


Abstract 

Van Lambalgen’s theorem states that a pair (a, j3) of bit sequences is Martin-Lbf random 
if and only if a is Martin-Lof random and /3 is Martin-Ldf random relative to a. In [Infor¬ 
mation and Computation 209.2 (2011): 183-197, Theorem 3.3], Hayato Takahashi generalized 
van Lambalgen’s theorem for computable measures F on a product of two Cantor spaces; he 
showed that the equivalence holds for each /3 for which the conditional probability F( |j8) is 
computable. He asked whether this computability condition is necessary. We give a positive 
answer by providing a computable measure for which van Lambalgen’s theorem fails. We also 
present a simple construction of a computable measure for which conditional measure is not 
computable. Such measures were first constructed by N. Ackerman, C. Freer and D. Roy in 
[Proceedings of the 26th Annual IEEE Symposium on Logic in Computer Science (LICS), pp. 
I07-I16. IEEE (2011)]. 

Michiel van Lambalgen characterized Martin-Lof randomness of a pair of bit sequences; 
Theorem 1 (van Lambalgen lb)). The following are equivalent for a pair (o:,)3) of sequences: 

• (Ct, j3) Martin-Lof random, 

• p is Martin-Lof random and (X is Martin-Lof random relative to j3. 

One can replace uniform (Lebesgue) measure in the dehnition of Martin-Lof randomness by any 
measure P. We call sequences that are random in this sense P-random^ There exist two definitions 
of Martin-Lof randomness for a pair of sequences. The hrst states that (o£, j3) is random if the join 
Cti PiUiPi... is random. The second dehnition uses the two dimensional variant of a Martin-Lof 
test, which is given by a family of uniformly effectively open sets t/„ C 2^ x 2^ such that the 
uniform measure of f/„ is at most 2^”. Both approaches are equivalent. 

To generalize van Lambalgen’s theorem for computable measures P, the hrst approach seems 
not suitable. Why join two sequences in this specihc way? What does it mean? Also, the most 
direct approach of replacing Martin-Lof randomness with P-randomness will make the theorem 
wrong for trivial reasons: There exist a computable P and a pair of sequences (oc, j3) such that 
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^ There exist two types of Martin-Lof tests relative to a non-computable measure P 0: 

• A uniform P-Martin-L6f test is a P-Martin-Lof test that is effectively open relative to each oracle that computes P. 

• A Hippocratic or blind P-Martin-Lof test is a Martin-Lof test that is effectively open without any oracle. 

If P is computable, then both types of tests define the same set of random sequences. Otherwise, the second type of tests 
defines a weaker notion of randomness, which we use here. Although the definition looks easier, it might not be the most 
natural definition of randomness relative to a non-computable measure P. 
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ai PiUiPi ■■■ is P-random, while a is not P-random. Indeed, let P be the measure that concentrates 
all its mass on the single point 010101, i.e., P({0101...}) = 1 and P{S) = 0 if OlOl-- - ^ S. 
The sequence 0101... is P-random, but 00... is not random. 

To use the two-dimensional approach, we need to decompose the bivariate measure P into two 
univariate measures. It is natural to use the marginal and the conditional measure for P. In fact, 
such decompositions are omnipresent in probability theory, and it nicely fits the statement of van 
Lambalgen’s theorem, which uses in the second criterion a conditionally and an unconditionally 
random sequence. 


We now define conditional measure. Let 2^ denote Cantor space. For any string x, let [x] be 
the (basic open) set containing all extensions of x. We say that a measure P on 2^ is computable if 
the function that maps each string x to P([ji:]) is computable as a real-valued function. Similar for 
measures P on 2^ x 2^. Following Takahashi Qol, we define for each measure P on 2^ x 2^, for 
each P S 2^, and for each measurable set S C 2^; 


Pc{S\li) = lim 


P{Sx[j5i...li„]) 

P(2Nx[i3i...^„])- 


Let the marginal distribution be Pm{S) = P(2^ x S). 

Remark; The definition of a conditional measure is usually given using the Radon-Nikodym 
theorem. In fact, this theorem defines a set of conditional measures, and each pair of such measures 
coincides on a set j3 of P^-measure one. Using the Lebesgue differentiation theorem it can be 
shown that these conditional measures also coincide with Pc(-1j3) for P^-almost all j3. We refer to 
the appendix for more details. 

This specific conditional measure is especially suitable to generalize van Lambalgen’s theorem 
because of the following result (see also lH] Lemma 10]): 

Theorem 2 l lfTOl Takahashi). If p is PM-random, then Pc(-|j3) is defined and is a measure. 

In |[T] Theorem 29, pl4] it is shown that for computable P, the measure Pc might not be com¬ 
putable. The measure that satisfies the conditions of our main result satisfies a similar property; 

Corollary 3 (of the proof of Theorem^. There exists a computable measure P on 2^ x 2^ such 
that the set of fi for which Pc(-|j3) is not computable relative to fi, has nonzero PM-measure. 

The corollary is proven after Theorem|5] Similar examples of such measures were invented by 
Jason Rute El- In the example from m, definitions of computability of functions and measures 
from computable analysis are used. They can be used on general spaces but are rather difficult to 
formulate. Functions that are not computable in this sense include all functions with a discontinu¬ 
ity. Therefore, the example in im is made in such a way that Pc(5|j3) is continuous in p for all 
measurable sets S. Using the same idea as in EIj we present a simplified construction of such a 
measure in the proof of TheoremElbelow. This proof does not rely on other parts of this note. 

Hayato Takahashi generalized van Lambalgen’s theorem as follows: 

Theorem 4 (Takahashi ifTTIfT^ '). For any computable bivariate measure P and any j3 such that 
Pc(-|j3) is computable relatively to j3, the following are equivalent: 

• (Ct, j3) is P-random, 

• P is PM-random and a is Pc{-\p)-random relative to p. 

For an alternative exposition of the proof and for related results, I refer to the upcoming ar¬ 
ticle 13 . One might ask whether the theorem only holds for p for which Pc(-|j3) is computable 
relative to pi Our main result shows that we can not drop this assumption, hence, van Lambalgen’s 
theorem fails for some computable measure. We emphasize that for a non-computable measure 
Q, our definition of Q-randomness corresponds to what is usually called blind or Hippocratic 
randomness in the literature (see footnote [T] for more details). 

Theorem 5. There exists a bivariate computable measure P on 2^ x 2^ and a pair of sequences 
(ct, j3) such that the pair is P-random and (X is not Pc{-\P)-random (thus even without oracle P). 
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Figure 1: Left; The measure P. Thick black lines represent concentrated measure. Right; Some 
values for P{I x [x]). From left to right; For I C [0, ai], P{I x [00]) = pi{I) and P{I x [10]) = 0. 
For I C [ai,a 2 ], we have P{I x [00]) = p{I)/2. For < r < s < 1 we have F’([r,s] x [x]) = 
H{[r,s] X [x]). 


Note that if (ct, j3) is P-Martin-L6f random, then j3 is FM-Martin-Lof random, and by Theo- 
rem|2]the measure Pc{-\I5) exists. 

Definitions Let /r be the uniform measure, i.e., /r ([x]) = for any string x. We also use /i for the 
product of two uniform measures over 2^ x 2^. Real numbers in [0,1] that are not binary rational, 
are interpreted as elements of 2^. For binary rational numbers a and j3, we associate [ct, j3] with 
the corresponding basic open set in Cantor space (thus only containing the binary representation 
of a with a tail of zeros, and a tail of ones for j3). 

Proof. There exists an increasing computable sequence a\, a 2 , ■. .of binary rational numbers that 
converges to a Martin-L6f random real a. (See e.g. ||3l Theorem 4.3].) To construct the bivariate 
measure F, modify the uniform measure on 2^ x 2^ as illustrated in figure [T] left; concentrate 
all measure in the vertical strip [0,ai] x2« uniformly in its lowest horizontal interval, i.e., in 
[0, ai] X 000...; concentrate the measure in the intervals [ai, a2] x [0] and [ai, a2] x [1] uniformly 
in their lowest positions, i.e., in [ai, a 2 ] x 000... and [ai, a 2 ] x 1000...; and so ono 

Before presenting the formal dehnition, let us illustrate the construction of F. Consider an 
interval / C [0, ai]. We have F(/ x [x]) = 0 if x contains at least one 1, and F(/ x [x]) = /r(/) 
otherwise, see figure [Tjright. For / C [ai, a2] we have F(/ x [Ox]) = P{I x [lx]) = 0 if x contains 
at least one 1 and jj. (/)/2 otherwise. 

We define the measure more formally for every basic open set / x [y] C 2® x 2®. We consider 
several cases; 

• If / C [a, 1], then F(/X [y]) = ^(/X [y]). 

• If / C [a„,a„+i] and |y| > n, then let y = wx where w represents the hrst n bits of y. If; 

- X contains at least one 1, then F(/ x [wx]) = 0, 

- otherwise, i.e. if x is empty or contains only zeros, F(/ x [wx]) = /r(/ x [w]). 

• Otherwise, we partition the basic open set in (countably many) other basic open sets that 
satisfy one of the conditions above. The measure is the sum of the measures of all sets in 
the partition. 

Note that for any string x, the F-measure of , a] x [x] equals the uniform measure, i.e., 

F([a|,,|,a] X [x]) = Ai([a|,q,a] x [x]). 

^ The construction has some similarities with the measure constructed in the proof of Proposition 6.3 in (2): the measure 
has also singularities that approach a left computable real. However, I believe there is no deeper correspondence between 
this measure and the measure constructed here. 
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Figure 2; The Martin-L6f test t/„ for fj. is obtained by trimming each basic set enumerated into a 
set Vn- 


The same holds for any set [r,i] x [x] with a|^.| < r < s < 1: x [x]) = l-L{[r,s] x [x]), see 

figure [T] right. P is computable, because a|^| is computable from x, and the vertical line at a|^| 
splits any interval I x [x] in at most two parts, see figure |2l for each part the P-measure is easily 
calculated; the measure of the part at the right of a|^| equals its uniform measure, and the measure 
in the left part can be partitioned into finitely many pieces which each satisfies one of the cases in 
the definition of P. 

We choose j3, such that (ct, j3) is Martin-L6f random relative to the uniform measure. By the 
original version of van Lambalgen’s theorem, it suffices to choose j3 to be random relative to a. 
Clearly, j3 contains infinitely many ones. 

We show that the pair (ct, j3) is also P-random. Let (V„)n£N be ^ Martin-L6f test relative to P. 
It suffices to convert this test to a Martin-L6f test {Un)neN relative to the uniform measure such 
that Vn and have the same intersection with the vertical line at position a. More precisely, it 
suffices for each U„ to be uniformly effectively open such that; 

• y„n({a}x 2 ’^) =t/„n({a}x 2 N), 

• p{Un)<P{V„). 

(Indeed, this implies that if (oc, j3) was not P-random, then it is also not random relative to the 
uniform measure and this would contradict the construction.) Construction of t/„; Each time an 
interval [r,s] x [x] is enumerated into a set Vn, enumerate its right part starting from a|^| into t/„, i.e., 
[max{r, a|j.| },i] x [x] if i > a|^| and nothing otherwise, see figureNote that Vn and U„ have the 
same intersection with the line at a because enumerated intervals are only modified at the left of 
ap.| < a. The sets t/„ are uniformly effectively open. Hence, the first condition is satisfied. Finally, 
observe that p(t/„) < P(V'n); for each enumerated interval [r,i] x [x], nothing is changed unless 
r < a|;f|, and in this case we have /i([a|^| ,i] x [x]) = P([a|^| ,i] x [x]) < P([r,i] x [x]). Because t/„ 
and Vn are the union of corresponding rectangles, the second condition is also satisfied. 

Because (o:,j3) is P-random, j3 is P^-random and Pc( |j3) is defined. It remains to show that 
a is not Pc(-|j3) random. We determine Pc(-|j3). Observe that if b is the empty string or a string 
that ends with a one, the measure 

P{- X [b]) 

PMm) 

is the uniform measure with support [a|^| ,1]. Because j3 is /i-random by construction, it contains 
infinitely many ones. Hence, the limit in the definition of Pc('|j3) (which exists), must be the 
uniform measure with support [a, 1]. This implies that the point a is not Pc( |j3)-random; the 
open sets t/„ = ]0, a -I- 2^"[ contain a for all n, are uniformly effectively open, and have P(-|j3)- 
measure 0{2^"). □ 

In the proof of Corollary|3] we use the following observation; 
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Lemma 6 (De Leeuw, Moore, Shannon and Shapiro 131). Let Q be a computable measure on 2^ 
and let a € 2^. If there exists a set of positive Q-measure of sequences that compute a, then a is 
computable. 

Proof Because there exist only countably many machines, there exists a unique machine that 
computes a from a set of sequences with positive Q-measure. Let c > 0 be a lower bound for 
this Q-measure. We can enumerate a binary tree containing all strings x that can be computed on 
this machine from a set of oracles that has Q-measure at least c. This tree contains at most \/c 
branches and each such branch is computable. □ 

We first repeat the corollary. 

Corollary 3. There exists a computable measure P on 2^ x 2^ such that the set of j3 for which 
PcflP) is not computable relative to j3, has nonzero Pm-measure. 

Proof Let a and P be as constructed above. Recall that a is random and therefore not computable. 
Pm is computable. The binary rational sequences have RM-measure a < 1, because P concentrates 
all measure at the left of a on the binary rational sequences, and at the right of a, these sequences 
have PM-measure zero. Let B be the set of PM-random sequences j3 that are not binary rational. 
This set has P^-measure 1 — a > 0. It remains to show that for P^-almost all j3 S P, the measure 
Pc(-|j3) can not be computed from j3. 

For each j3 S P, the measure Pc(-|j3) equals the uniform measure with support [a, 1]. Let R be 
this measure. The functionx i—s- P([x]) computes a, hence R is not computable. Lemma |6] implies 
that the set of j3 that compute R has P^-measure zero. Hence, at most a PM-measure zero of S P 
do not satisfy the conditions of the corollary. □ 

Unfortunately, for any [x] C [0,a], the function Pc([x]|-) is nowhere continuous. It is only 
continuous in the set of points that are not binary rational, and this set is not negligible (it has Pm- 
measure a). Therefore, we present another example of such a measure for which the conditional 
measure is continuous, even for all j3. 

Theorem 7. There exists a computable measure P on N x 2^ such that: 

• for each P C N, the function Pc(P|-) is defined and continuous on 2^, 

• the set of j3 for which Pc(-1 j3 ) is not computable relative to j3, has PM-measure one. 

Proof. Let A be a computably enumerable set that is not computable (for example the Halting 
problem). Fix an algorithm that enumerates the elements of A, and for each n S A let f„ be the 
time at which this algorithm enumerates n. The idea of the construction of P is the same as in m: 
if n ^ A, then the measure P({n} x •) is uniformly distributed over 2^. Otherwise, the measure 
is non-uniform, but only at a very small scale, i.e., for |x| < f„, the values of P{{n} x [x]) do not 
depend on whether x G A or not, and only for |x| > t„ the values are different. In this way, we 
guarantee that P is computable; if l-^l ^ a program that computes P({n} x [x]) on input (n,x) 
can discover whether n G A and compute the different value. Because the conditional measure is 
defined in the limit, Pc(-|j3) depends on this small scale structure, and therefore, the conditional 
measure can encode non-computable information. 

To define P, we use the functions /o and f\ which are defined graphically in the figure below. 
More precisely, /o is the unique piecewise linear function whose graph contains the points (0,2), 
(1/4,0), (2/4,0), (3/4,2) and (1,2). f\ is defined by the relation/i(r) =/o((r— 1/4) mod 1) for 
r G [0,1]. Note that the average of f over 2^ is 1 for i = 0,l. For j3 G 2^, let j3r be the fth bit of j3. 
Note that 

P fi iPi+ipi+2 ■ ■ ■) 

is the function obtained by repeating /, with period 2^'. These functions are all continuous and 
have average 1. 

Let us first define P using the following density, see figured 


f{n,P) 


2 -"/o(i3,„+ij3,„+2 ...) ifnGA 
2 ^" otherwise. 


Thus, P({n} X [x]) = /[^]/(n,^)d/3. 
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Figure 3: Left; measures /o and /i over 2^. Right; measure P over N x 2^. 


Let P{n\l5) be short for Pc({n}|)3). We now show that this function is continuous in p. The 
marginal density fu = LieN/lF') continuous, because it is a uniformly convergent sum of 
continuous functions. Also, /m is bounded from below by a positive constant (if m ^ A, then 
/m > 2^™). Hence, the conditional measure is continuous on singleton sets; 


P{n\P) 


f{n,P) 


For 5 C N, P{S\P) is a uniformly convergent sum of continuous functions, and hence also contin¬ 
uous. 

By Lemma|6] it remains to show for each j3 that P{-\P) computes A, (i.e., A is computed by a 
machine that has oracle access to approximations of P{n\P) of any precision). For each fixed j3, 
the values of P(n|j3) for all n ^ A are the same. Unfortunately, there can be many n € A for which 
P{n\P) is close to this value. Hence, A might not be computable from P(-|j3). 

We now adapt the construction. The new measure P encodes membership of n in A using two 
values of the conditional measure; P{2n\P) and P{2n + l|j3). Note that for each j3 G 2^ at least 
one of the values /o(j3),/i (j3) is either 0 or 2. Hence, for b G {0,1}, we define P using 


f{2n + b,P) 


ifnGA, 

2-2n-b Otherwise. 


For the same reasons as before, P{n\-) is continuous. Fix an m ^ A and note that P{2m\P) > 0. If 
n G A at least one of the values 


P{2n\P)2^’' F(2n + l|j3)22«+' 

F(2m 1)3)22™’ p(2m 1)3)22™ 

equals 0 or 2; otherwise, both values equal 1. Hence, for each )3 the measure F(-|)3) computes A. 
(Because infj3 P(2m|)3) > 0, the reduction can even be made uniformly in F(-|)3) for all )3.) □ 


Appendix: Two definitions of conditional measure coincide 

In probability theory, conditional measures are defined implicitly using the Radon-Nikodym the¬ 
orem. Any measure that satisfies the conditions of this theorem can be used as a conditional 
measure. The following lemma states that such measures are almost everywhere equal to the 
conditional measure Pc defined above. 

Lemma 8 (Folklore). Let 2* be the set of strings. For every measure P on 2^ x 2^ and for every 
function f : 2* x 2^ such that for all x and y 

M, M) = / f(x, P )Pm( dp ), 

-'M 

we have that ff,P) = Fc([’] \P) faf" oil p in a set of P^-measure one. 
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In the proof we use the Lebesgue differentiation theorem for Cantor space. The proof of this 
version follows from the proof for Real numbers. 

Theorem 9 (Lebesgue differentiation theorem for Cantor space). Let Qbe a measure on 2^. For 
every Q-integrable function g : 2^ —>■ R we have that 




m 


for Q-almost all p. 

of Lemma\^ For a fixed x, apply the Lebesgue differentiation theorem with g(-) = f{x,-) and 
Q = Pm- By assumption on /, the nominator simplifies to P([x], [j3i.. .)3„]). It follows that /(x,j3) 
differs from F’c([x]|j3) in at most a set of j3 with FM-measure zero. Because there are countably 
many strings x, it follows that /(•, j3) and Fc([']li3) differ in at most a set of PM-measure zero. □ 
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